On Bellman's principle with inequality constraints

نویسندگان

  • Edwin K. P. Chong
  • Scott A. Miller
  • Jason Adaska
چکیده

We consider an example by Haviv (1996) of a constrained Markov decision process that, in some sense, violates Bellman’s principle. We resolve this issue by showing how to preserve a form of Bellman’s principle that accounts for a change of constraint at states that are reachable from the initial state.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Existence and Exponential Stability of Positive Almost Periodic Solutions for a Model of Hematopoiesis

By employing the contraction mapping principle and applying Gronwall-Bellman's inequality, sufficient conditions are established to prove the existence and exponential stability of positive almost periodic solution for nonlinear impulsive delay model of hematopoiesis.

متن کامل

A Unified Generalization of Aczél, Popoviciu and Bellman’s Inequalities

In this paper, we give a unified generalization of Aczél, Popoviciu and Bellman's inequalities. The result is then applied to deriving a refinement of Aczél's inequality and Bellman's inequality. As consequences, several interesting integral inequalities of Aczél-Popoviciu-Bellman type are obtained.

متن کامل

A Neural Network Method Based on Mittag-Leffler Function for Solving a Class of Fractional Optimal Control Problems

In this paper, a computational intelligence method is used for the solution of fractional optimal control problems (FOCP)'s with equality and inequality constraints. According to the Ponteryagin minimum principle (PMP) for FOCP with fractional derivative in the Riemann- Liouville sense and by constructing a suitable error function, we define an unconstrained minimization problem. In the optimiz...

متن کامل

Fully fuzzy linear programming with inequality constraints

Fuzzy linear programming problem occur in many elds such as mathematical modeling, Control theory and Management sciences, etc. In this paper we focus on a kind of Linear Programming with fuzzy numbers and variables namely Fully Fuzzy Linear Programming (FFLP) problem, in which the constraints are in inequality forms. Then a new method is proposed to ne the fuzzy solution for solving (FFLP). Nu...

متن کامل

Hamilton's Principle as Variational Inequality for Mechanical Systems with Impact

The classical form of Hamilton’s principle holds for conservative systems with perfect bilateral constraints. Several attempts have been made in literature to generalise Hamilton’s principle for mechanical systems with perfect unilateral constraints involving impulsive motion. This has led to a number of different variants of Hamilton’s principle, some expressed as variational inequalities. Up ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Oper. Res. Lett.

دوره 40  شماره 

صفحات  -

تاریخ انتشار 2012